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We present a renormalization group (RG) approach to explain universal features of extreme 
statistics, applied here to independent, identically distributed variables. The outlines of the theory 
have been described in a previous Letter, the main result being that finite-size shape corrections to 
the limit distribution can be obtained from a linearization of the RG transformation near a fixed 
point, leading to the computation of stable perturbations as eigenfunctions. Here we show details 
of the RG theory which exhibit remarkable similarities to the RG known in statistical physics. 
Besides the fixed points explaining universality, and the least stable eigendirections accounting for 
convergence rates and shape corrections, the similarities include marginally stable perturbations 
which turn out to be generic for the Fisher- Tippett-Gumbel class. Distribution functions containing 
unstable perturbations are also considered. We find that, after a transitory divergence, they return 
to the universal fixed line at the same or at a different point depending on the type of perturbation. 

PACS numbers: 05.40.-a, 02.50.-r, 05.45.Tp 



I. INTRODUCTION 

Using present data-acquisition methods, it has become 
possible to build enormous databases in practically all 
fields of science. The large size of these databases make 
their analysis rather intricate, but questions can now be 
posed which were previously unanswerable. In particu- 
lar, quantitative studies of extreme events have become 
feasible. Accordingly, extreme value statistics (EVS) has 
found its way from mathematics [l], to various disci- 
plines, foremost among them those fields where the ex- 
tremes involve great risks as in engineering 3| , finance [|| , 
hydrology [j|, meteorology @, geology [7|. In physics, 
extreme statistics was relatively dormant until the last 
decade when a number of studies appeared in relation 
to spi n glasses [1] , interface- and landscape-fluctuations 
[jj-Rq. random frag mentation [l7j . level-density in ideal 
quantum gases [18j , atmospheric time series [191, etc. 

The above studies revealed that an important prob- 
lem with the quantitative application of EVS is the slow 
convergence in the size N of the data set whose ex- 
tremum is sought. A well known example is that the 
Fisher-Tippett-Gumbel limit distribution for indepen- 
dent, identically distributed (i.i.d.) variables is typically 
approached logarithmically slowly, i.e. proportionally to 
1/lniV. This convergence problem is not cured even by 
the present size of the databases, thus studies of finitc- 
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size corrections are needed for a thorough analysis of 
EVS. While the mathematical literature contains results 
on the rate of convergence to the universal limit distribu- 
tions [2(| , and particular cases for correlated variables 
have also been studied in physics [1$ . to our knowledge, 
finite-size effects have apparently been ignored in most 
empirical data analysis. 

In order to develop a readily usable theory of finite- 
size corrections giving not only the amplitude of the 
corrections but also providing shape corrections to the 
limit distribution, we recently introduced a renormaliza- 
tion group (RG) approach for the case of i.i.d. variables 
[23| . The concept of using RG in probability theory has 
been pioneered by Jona-Lasinio [24[ in connection with 
critical phenomena. In the context of EVS, the real- 
space RG methods have been applied to random land- 
scapes [III, [25|. In our case, it turned out that the RG 
equation is just a physicist's reformulation and a sim- 
ple generalization of the original fixed point equation of 
Fisher and Tippett [l|. Within this approach, the fixed 
point condition yields the known one-parameter (7) fam- 
ily of solutions which provides the traditional classifica- 
tion of EVS limit distributions (Fisher-Tippett-Gumbel, 
-Frechet, -Weibull). The RG approach is instrumental in 
determining the finite-size corrections as well, since they 
emerge from the action of the RG on the neighborhood of 
the fixed point. We found that the resulting eigenvalue 
problem and the emerging eigenfunctions represent the 
generic leading finite-size correction functions. An im- 
portant outcome of the general considerations is that the 
first order shape corrections display universality. Namely, 
within a class of limit distributions characterized by 7, 
the correction is determined by a single additional pa- 
rameter 7'. The 7 is long known to be related to the 
leading asymptote of the parent distribution, while 7', 
emerging as an eigenvalue index from RG, is determined 
by the next-to-lcading asymptote of the parent distribu- 



2 



tion which is in accordance with the mathematical re- 
sults [13, HH . Note that our RG framework also provides 
a simple example in addition to a series of known exact 
RG schemes [13, IH-Ull - 

The above RG picture and the corresponding results 
have been briefly presented in a recent Letter |23[ . Here, 
we offer an extended and more detailed view on our work 
with new aspects relating to the nonlinear neighborhood 
of the fixed line including nonlinear manifolds. In partic- 
ular, a detailed derivation of the RG picture is presented 
in Sec. |H] where the fixed line of the RG transforma- 
tion, parametrized by 7, is linked to the EVS limit dis- 
tributions. Next, linear perturbations around a point on 
the fixed line are considered. The eigenvalue problem is 
solved (Sec. Illlj) . giving rise to a new parameter 7'. The 
general aspects of the theory are developed further in 
Sec. IIVI where the RG transformation beyond the linear 
neighborhood of the fixed point is formulated to treat 
the case of marginal eigenfunctions within the Fisher- 
Tippett-Gumbel class. The practical consequences are 
discussed by connecting to the finite size properties in 
typical EVS problems and showing that the parameter 7' 
is the finite-size scaling exponent (Scc.|V|. Furthermore, 
the relationship between 7' and the parent distributions 
is determined, and we analyze in detail a family of par- 
ents with generalized exponential asymptote frequently 
occuring in applications. The question of unstable per- 
turbations and the invariant manifolds associated with 
them are examined in Sec. IVI( and they are illustrated 
on a scries of examples. Finally, the conclusion and pos- 
sible avenues for further application of the RG scheme to 
EVS problems are found in Sec. I VIII 

II. RENORMALIZATION GROUP 
TRANSFORMATION AND ITS FIXED LINE 

In this section we recuperate known basic properties 
of EVS and explain the emergence of limit distributions 
within the framework of RG theory. This is essentially a 
reformulation of the original proposition of the seminal 
work by Fisher and Tippctt which we will further 
develop in subsequent sections. 

The basic question of EVS is the limit behavior of 
the distribution of extremal values of random variables. 
In what follows we shall restrict our attention to max- 
ima, i.e., the distribution of the largest variable, but by 
a sign change this is equivalent to the problem of min- 
ima. Suppose that we have a "batch" of random variables 
Z\, Z2, ■ ■ ■ , 2at, and we ask about the statistical properties 
of the largest z = max {z l7 z 2 , . . . , z/v}. The question has 
a simple answer, if the original variables z t were inde- 
pendent, identically distributed, each according to the so 
called parent probability density p(z). The simplicity is 
apparent when using the integrated (cumulative) distri- 
bution 




(II.1) 



i.e. the probability that the variable is not larger than 
z (we assume here and later nonsingular densities, and 
differentiability if necessary). Then the probability that 
the maximum is not exceeding z is given by the joint 
probability that all variables do not exceed z, hence the 
integrated distribution of the maximum of batch of ./V 
variables, the extreme value distribution (EVD) is 

Air*(z) = » N {z). (II.2) 

Since the integrated parent distribution /i(z) is less 
than one whenever z is within the support of the parent, 
the above quantity will converge to zero there for any 
fixed z. However, we can ask whether there is a linear 
change of variable so that for large N the EVD is restored 
to a nondegenerate function in the large N limit. Specif- 
ically, we ask about the existence of parameters ai\r,bi\r 
such that 

M N (x) = M^(a N x + b N ) -> M(x), (II.3) 

where the resulting integrated distribution represents the 
extreme value limit distribution. It is related to the limit 
density as P(x) = M'(x). 

Note that the parameters a at, &at are not unique, if one 
choice produces a nondegenerate limit EVD then adding 
constants to either will also yield another one. This ambi- 
guity can be eliminated by a standardization convention, 
for example 

M(0) = P(0) = 1/e. (II.4) 

We can require this condition also at finite stages in the 
limit (|TTT3|) for the maximum distribution Mn(x), which 
specifies uniquely the parameters ajy , 6 at . 

Now let us turn to the invariance condition, which fol- 
lows from the fact that M(x) is a limit distribution of 
EVS. The reason behind this invariance is that if p vari- 
ables come from a parent that is a limit EVD, then their 
maximum will be also distributed according to the same 
limit EVD. Indeed, conceiving each of the variables as 
themselves representing maxima of some other large col- 
lection of variables, the distribution of their overall max- 
imum will obviously be again the same limit EVD. Since 
these statements are valid up to a linear change of vari- 
able, for the limit EVD we obtain 

M{x) = M p (a(p)x + b{p)), (11.5) 

with appropriate scale- and shift paramenters, a(p) and 
b(p). While here p should be a positive integer, we can 
easily convince ourselves that it can be any positive ra- 
tional. Indeed, considering another N' = Np, where p is 
fixed during the large size limit, and making use of 

M N (x) « M Np (x), (11.6) 

we obtain by pi.2III.3p again (|II.5|) . Then p can in fact 
be continued to positive real numbers. The parameters 
a(p),b(p) in (|II.5|) should be consistent with the stan- 
dardization pi.4|) . In sum, condition (|II.5|) should be 
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understood such that if M(x) is a limit distribution then 
it should solve (|II.5[> for any p with parameters ensuring 
pi.4p . This is known in the mathematical literature as 
the condition of max-stability, appearing first in the clas- 
sic paper by Fisher and Tippett (l| and now an exercise 
in textbooks on EVS. 

In order to go later beyond the invariance condition, 
following our short paper (23|, we will identify the RG 
transformation of an integrated distribution fi(x) by the 
following operation 



[RplA(x) = p p (a(p)x + b(p)). 



(11.7) 



One can easily see that the standardization of the type 
(III.4[) for \R p p\(x) requires 



b(p)^p- 1 (e- 1 /n, 

db{p) 



a(p) = p- 



dp 



(II. 
(II, 



a condition forming part of the RG operation. Note that 
traditional RG used in critical phenomena is in fact a 
semigroup since, due to the elimination of degrees of free- 
dom, the inverse element is missing. In our case, however, 
the transformations form a group, as the inverse element 
of a transformation with parameter p has parameter 1 /p. 
Obviously, p < 1 corresponds to the decrease of the batch 
size, but the above RG transformation is still meaningful. 

We should note that, although there arc differences, 
the EVS version of the RG transformation [eqs. f|II.7|II.8[) ] 
has the spirit of the traditional RG. Namely, the rais- 
ing to power p > 1 and shifting by b(p) decreases the 
weight of the small argument part of the parent distri- 
bution (eliminating the irrelevant degrees of freedom), 
while rescaling by a(j>) is analogous to the rescaling of 
the remaining degrees of freedom. 

Within RG theory, the invariance condition (III.5j) be- 
comes a fixed point relation 



[RpM](x) = M(x). 



(11.9) 



Concerning terminology, we mention that while in math- 
ematical texts max-stability is essentially the fixed point 
relation, in the RG framework stability is characterized 
by the response to small deviations from the fixed point, 
to be investigated later in the paper. 

One can easily solve (|II.9|) by introducing the function 
f(x) as 



M(x) = e 
wherc standardization (|II.4|) requires 
/(0)=0, f(0) = l, 



(11.10) 



(11.11) 



furthermore, from pi.8[) the parameters can be written 
in terms of / as 



6(p) = /- 1 (lnp), 
o(p) = V/'(6(p)). 



(II. 12a) 
(II.12b) 



The equation for / can be obtained from (|II.9|) . that is, 
writing (|II.5j) as 



f(x)=f(a( P )x + b(p))-lnp (11.13) 



whence 



f(x) = a(p)f(a(p)x + b(p)). 



(11.14) 



It follows that the sought solution for /', independent 
of p, is the reciprocal of a linear function. The only 
form consistent with (jll.ll[) allows one free parameter, 
7, yielding 



/'(z;t) 



1 



1 + "fX 



(11.15) 



where here and later ' means differentiation by x, and 
b(p) = 7~ 1 (a(p) — 1) should hold. Again using pi.ll[) we 
get by integration the one-parameter family 



/(a;; 7) = 7 1 ln(l +735), 
and (|II.12p requires 

a(p,l) =P 1 , 

b(p,i) = 7~ 1 (P 7 - !)• 



(11.16) 

(H.17a) 
(II.17b) 



Equation pi.!6[) gives with (jll. 10|) the well known gener- 
alized extreme value distribution and the respective den- 
sity 



Af(a?;7) 



-{l+ 1 x)- 1 '-< 



(11.18a) 



P(x; 7 ) = {l+ T x)- lh - 1 e- {1+ ^ x) U \ (II.18b) 

with support extending to the range 1 + 72; > 0. This 
one-parameter family constitutes a fixed line of the RG 
transformation. The cases 7 < 0, = 0, > were studied 
separately already by Fisher and Tippett [l|, and cor- 
respond to the traditional categorization into Weibull, 
Gumbel, and Frechet universality classes, respectively. 
The 7 < case gives the limit distribution of integrated 
parent distributions approaching 1 like a power — 1/7 at 
a finite upper border, 7 = corresponds to faster than 
power asymptote at either a finite limit or at infinity, 
and 7 > represents parent distributions approaching 1 
at infinity with a power — 1/7. These three cases will be 
referred to by the abbreviations FTW, FTG, and FTF, 
respectively. 



III. EIGENVALUE PROBLEM NEAR THE 
FIXED POINT 

A. Perturbation about the fixed point 

While the above fixed point condition is a textbook ex- 
ample of deriving the limit distributions of EVS, its per- 
turbation has not been studied. Nevertheless, such per- 
turbations arc important since they naturally give rise to 
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finite-size corrections. Before elucidating the connection 
to finite-size scaling, let us consider the function space 
about the fixed point and its transformations under the 
RG operation represented by the right-hand-side of (III.5[) . 
Introduce the perturbed distribution function 



M(x;j,e) = M(x + etp(x);j), 



(111.1) 



where M(x; 7) is assumed to satisfy the fixed point condi- 
tion. We insert the perturbation into the argument since 
this leads to a simpler formulation later. Alternatively, 
one can also define 



M(x; 7, e) = M (x; 7) + eP(x; j)ip(x). 



(III.2) 



The two formulas are equivalent to linear order in e. On 
the other hand, for a given finite e the monotonicity con- 
dition for the integrated distribution M(x; 7, e) in x may 
impose different restrictions on ip(x). Generically, both 
formulas can be understood as approximations for small e 
of some distribution with general e dependence, sufficient 
for the present purposes. If we consider finite perturba- 
tions, that will be explicitly stated and the monotonicity 
condition discussed. 

The standardization condition of the type (|II.4|) for 
both of the above integrated distribution functions is sat- 
isfied by 



ip(Q) = 0, V'(0) = 0, ip"(0) 



-1. 



(III.3) 



The third condition sets the sign and scale of e, the minus 
sign is just a convention which will be justified later. Note 
that in our short communication [23| we used i/j"(0) = 1, 
so in comparisons a sign change should be understood. 



B. Eigenvalues and eigenfunctions 

Now we shall study the eigenvalue problem of the lin- 
earized RG transformation around the fixed point, specif- 
ically, when the RG transformation changes the magni- 
tude of the perturbation while leaving its functional form 
invariant. In other words, we are seeking the linear part 
of the invariant manifold of the RG emanating from the 
fixed point. 

To make notation simpler in this section, we often omit 
the 7 and p arguments, when they are obviously implied, 
e.g., we use M(x;e) for M(x;-f, e), etc. We start out 
from (jHI.ip . apply the RG transformation, and assume 
that the result is of the same functional form with only 
the perturbation parameter changing 

[R p M(e)](x) = M p (a(e)x + 6(e); e) = M{x\ e'), (HI.4) 

where linearization in e and e' is understood. The trans- 
formation parameters are also expanded 



a(e) 
6(e) 



- eai, 
e6i, 



(III.5a) 
(III.5b) 



with the zeroth order values a, 6 taken from pi.!7[) and 
the first order corrections a±, b\ to be determined from 
the standardization condition (|II.8[) with \i(x) = M(x; e). 
Using pil.ip and (|II.10[) in these conditions we straight- 
forwardly get 



61 = -4>(b) 

a\ = —i/)(b)a. 



(IH.6a) 
(III.6b) 



What is left is to determine the possible values of e' and 
the associated invariant function ip(x). 

We now use (|II.16[) and (|II.10[) . expand to linear order 
in e and e' in the second exponential, and introduce their 
ratio as eigenvalue 



A = e'/e. 



Then wc obtain 



\aip(x) = %jj(ax + 6) + a\x + 61 

= ip(ax + 6) — "0(6) — atp (b)x. 



(III.7) 



(III.. 



We used (|III.6[) to obtain the second line, which makes it 
obvious that the role of the constants a\, b\ is to ensure 
the first two conditions in (|III.3|) . 

By differentiation we can eliminate the linear part 



(X/a)ip"(x) = iP"(ax + b) 



(III.9) 



We remind the reader that a, 6 are given in (|II.17|) and 
change continuously with p, furthermore, we recall that 

l + 7 (a.T + 6) = a(l + 7x). (111,10) 

Thus the p independent solution is 

ip"(x) = -(l+ 7 a;) Q , (111.11) 

where the coefficient — 1 follows from the third condition 
in (|III.3|) . and the eigenvalue is obtained as 



X = a a+1 = p T( Q+1 ) 



(111.12) 



where we also used pi,17a|) . The parameter a labels the 
eigenfunctions, but it is more convenient to introduce 
7' = 7 (a + 1), which gives 



^"(x; 7 ,7')--(l+7^ 7 ' /7 ~ 1 , 
\{i)=p>'. 



(111.13) 
(111.14) 



Linear stability of the fixed point for p > 1 means that 
A < 1, then 7' < 0, the marginal case is A = 1,7' = 0, 
while A > 1,7' > characterizes unstable directions. 

The eigenfunction is obtained by integrating eci JIILllT) 
while satisfying the conditions (|III.3|) 



V>(a;;7,7') 



dy / dz(l +7Z) 777 " 1 



1 + (7' + j)x - (1 + 7^) 7 ' /7+ 
7' (7' + 7) 



1 (111.15) 
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Note that for 7 = 7' (|III.15[) simplifies to 



^(2^7,7) = — - 



(111.16) 



irrespective of the value of 7. A function equivalent to 
(|III.15jl has been found in 0, H3] when studying con- 
vergence to the limit distribution, after starting out with 
parent distributions in the appropriate domain of attrac- 
tion. 

Knowing ifj, a substitution in (|III.6|) yields the correc- 
tions to the parameters as 



V 



i 

7+7' 



1 



7'(7 + 7') 77' 7(7 + 7') 



(III. 17a) 
(III.17b) 



Summing up this section, we found using the RG the- 
ory that, for each fixed point specified by a 7, the lin- 
earized RG transformation yields a one-parameter family 
of eigcnfunctions ij){x; 7, 7'). The role of the index 7' will 
be elucidated below in SeclVl 



C. Marginal eigenfunctions 

We can immediately surmise that marginal eigenfunc- 
tions should appear on the line of fixed points f(x;j) 
(|II.16|) . Since two fixed point functions stay the same 
upon the action of the RG transformation, their differ- 
ence is also invariant with respect to the RG. If, in par- 
ticular, the difference function was small, i.e., the two 
fixed points were differing by an infinitesimal increment 
in 7, then the difference function can be considered as a 
linear perturbation about either fixed point and, based 
on its invariance upon the RG, it should be proportional 
to the marginal eigcnfunction with eigenvalue A = 1. By 
(IIII.14[) this implies 7' = 0, whence we conclude that 
ip(x; 7,0) should emerge as an eigcnfunction. 

The above reasoning is confirmed by a simple calcula- 
tion. First we display the marginal eigcnfunction from 



A comparison with (|III.2|) shows that indeed the differ- 
ence of two infinitcsimally close fixed point distributions 
is given by the marginal eigcnfunction. This is interest- 
ing also from the viewpoint that one can determine the 
marginal function without solving the eigenvalue prob- 
lem, by differentiation in terms of 7. Presumably for 
non-marginal functions it remains necessary to consider 
the traditional eigenvalue equation. 

As a side-remark, the scale and sign of the eigcnfunc- 
tions (|III.15jl were defined by the requirement (|III.3|) . 
This had the consequence that the perturbation formula 
(|III.20[) has as small parameter e just the increment in 
7. Any other convention for the curvature at the ori- 
gin in (|III.3j) would have introduced an extra factor in 
the perturbation in (IIII.20aj) . so the prescription (|III.3l) 
indeed provides the most natural scale and sign of the 
eigenfunctions. 



IV. BEYOND LINEARIZED RG IN THE 
MARGINAL CASE 

Here we shall deal with the situation when 7' = 0, i.e., 
from (|III.14|) the eigenvalue A = 1, so within linear the- 
ory the size of the perturbation does not change under 
the action of the RG transformation. That is, the per- 
turbation with such an eigenfunction is marginal, and we 
have to extend the RG formulation to terms nonlinear in 
r. 

For the fixed point with nonzero 7, when the parent 
distribution has a power asymptote, the case of 7' = 
seems to be atypical, because i/j(x; 7, 0) has a logarith- 
mic singularity as shown in (|III.18|) . On the other hand, 
in the FTG class with 7 = the case 7' = can be 
considered as generic, because the correction function 
ip(x;0,0) = —x 2 /2 represents the natural analytic per- 
turbation in pil.ip . We shall thus limit the RG study in 
the nonlinear neighborhood of the fixed line to the FTG 
case. Consider the most natural extension of (jlll.lj) with 
7 = 7' = (these arguments will be omitted in this sec- 
tion) as 



(ImTsli 



M(x; e) = M(x - ex 2 /2 + e 2 ip 2 (x)), 



(IV.l) 



ip(x; 7, 0) = 7~ 2 [yx - (1 + jx) ln(l + jx)] . (III. 18) 

On the other hand, let us invoke the fixed point distribu- 
tion pi,18a[) and expand to leading order in 7 — 70 about 
some nearby 70. It is easy to see that 



^M(x;7) =P(a;; 7)^57,0), 



(111.19) 



with the definition (|III.18|) . so finally we obtain for the 
perturbed fixed point 

M(x; 7) « M (x; 70) + eP(x; 7o ) 1>(x, 70, 0), (111.20a) 
e = 7 - 70. (III.20b) 



where M(x) = e e and we require 

V> 2 (o) = V4(o) = V2(o) = o ; 



(IV.2) 



where the first two equations follow from the standard- 
ization condition (|II.4jl while the third one sets the scale 
of e. 

The RG transformation is again given by pil.4[) where 
the right-hand-side should be expanded to second order 
in e and 



a(e) = 1 + e hip + e 2 02, 
b(e) = ]np+ |ln 2 p + e 2 6 2 



(IV.3a) 
(IV.3b) 
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Here the terms up to linear order in e were taken from the 
7, 7' ->• limit of (|II17p , Since by (|III.14|) the eigenvalue 
is now A = 1, i.e., the eigenfunction is marginal to linear 
order, we assume an analytic extension of e' = Ae as 

e' = e-re 2 . (IV A) 

Nonlinear stability then requires |e'| < |e|, thus re > 0. 
If re < then we have an unstable direction. 

Straightforward calculation based on the RG transfor- 
mation of (JUll) together with (|IV.3IIV.4p yields 

ip'zix + lnp) =^(x)+2\np + r. (IV.5) 

The p-indcpcndcnt solution tp of this equation is linear 

tl%{x) = sx, (IV. 6) 

where s is arbitrary, and r is determined as 

r=(s-2)]np. (IV. 7) 

Hence 

e' = e-e 2 (s-2)lnp, (IV.8) 
and using (|iV.2p we obtain 

^ 2 (x-s)= S -x\ (IV.9) 


Thus we find that in this order a new additional param- 
eter s arises. The corrections to the transformation pa- 
rameters can also be calculated as 



3-s 2 
«2 = — — In p, 

b 2 = -—In 3 p. 
6 



(IV.10) 
(IV.ll) 



Nonanalytic corrections dominating the quadratic in e 
can studied by the ansatz 



e — re 



«, 1<£<2. 



(IV.12) 



Carrying out an analysis similar to the above one, we 
again obtain the cubic eigenfunction pV.9[) but now r = 
s lnp. 

Next, the above results will be used to obtain practi- 
cable finite-size expressions in EVS. 



V. FINITE SIZE SCALING 

So far we have been studying the abstract space of dis- 
tribution functions under the action of the RG transfor- 
mation. Below we explain how the results on the eigen- 
functions near a fixed point can be translated to the size 
dependence of the convergence to the limiting E VD start- 
ing out from a particular parent distribution. 



A. The finite-size exponent 7' 

Consider the basic situation described in Sec. [U 
namely, the EVD M^(x) approaches one of the fixed 
points M(x;j) for a diverging batch size N. Then it is 
natural to assume that the convergence for large N oc- 
curs along a dominant eigenfunction, approximated by 
the form flllljl . with some e — £n- Further p iterates 
of the extreme value distribution by the RG transforma- 
tion corresponds to increasing the batch size to pN, and 
so, according to (|III.4|1 . it generates a new perturbation 
parameter 



e p N = A 7 '£at. 



(V.l) 



Using now A (7') = p 1 (|III.14|) and assuming a power law 
dependence for e^r, one obtains 



(V.2) 



Hence the meaning of the parameter 7' follows, it is the 
exponent of the leading finite-size correction to the limit 
distribution. Clearly, 7' < is needed for power-like de- 
cay whereas a correction faster or slower than power-law 
should be characterized within the RG theory of linear 
perturbations by a 7' = —00 and 7' = 0, respectively. 



B. Marginal case near the FTG fixed point 

One expects that slower than power such as logarith- 
mic corrections are also consistent with (|V.1|) and they 
emerge in the 7' — > limit. We study this case by consid- 
ering the marginal situation near the FTG fixed point, as 
described in Sec. IIVI Again we take an ejy function, and 
get in one RG step e' = t p N- Expanding the reciprocal 
of (|IV.8jl yields in leading order 



1 1 



(s - 2) lnp. 



(V.3) 



This is a functional equation for whose solution is 

the logarithm function, yielding 



f 



CAT 



(s - 2) In AT' 



(V.4) 



Thus in the case 7 = 7' = the natural assumption of 
analyticity in e leads to the cubic next-to-lcading correc- 
tion, and entails the logarithmic decay of the finite-size 
correction. This can be considered as the generic sta- 
ble manifold about the FTG fixed point and explains the 
typically slow, 1/lniV, decay of the corrections. 

Note that the above results consistently describe stable 
perturbations. Indeed, PV.8[) gives an e' closer to zero 
than e, if e has the same sign as s — 2. But this is just 
what we obtained in (|V.4[) . 

A more general case is when the nonlinear extension 
in the marginal situation is PV.12[) . Translating that to 
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the finite-size correction we have in the end 

A 



(\nN) — 
sgnp) 

[W(£-i)H 



(V.5) 
(V.6) 



Hence RG theory accounts for faster-than-logarithmic de- 
cay in the case of an invariant manifold nonanalytic in 
r. 

The conclusions drawn from the results of the RG 
study beyond the linear region are quite revealing. The 
correction characterizes how fast the parent distribution 
approaches the FTG fixed point. A quite slow but typ- 
ical case is when the parent is attracted by the RG 
transformation to an invariant manifold analytic in both 
x and the perturbation parameter e, yielding a finite- 
size correction logarithmically decaying in N . If the e- 
dependence is not analytic in next-to-leading order then 
a larger power of the log and so faster decay is obtained. 
These cases correspond to 7' = and polynomial cor- 
rections in x, quadratic in leading and cubic in next-to- 
lcading order. Faster, essentially power-law correction 
is obtained if the convergence is characterized by 7' < 0, 
when the correction function is no longer polynomial. Fi- 
nally, faster than power decay corresponds to the case 
7' — > —00, thus it falls beyond the validity of the present 
RG theory. 



C. Connection to the parent distribution 

It remains to be seen how the perturbation parameter 
ejv can be determined from the parent distribution. That 
is, we start out from the classic extreme value problem 
of the distribution of the maximum of N i.i.d. variables, 
each characterized by the same parent distribution. Let 
us write the integrated parent distribution as 



(V.7) 



then the distribution of the maximum of N variables is 



M^(z) = fa) 



N 



-Ne~ 



(V.8) 



Let us assume that n(z) belongs to the domain of attrac- 
tion of the fixed point distribution M (x; 7) from (Ill.lSal) . 
Then, by using the linear transformation ensuring the 
standardization (|II.4j) 



ClNX + bit, 
In AT, 
1/ajv, 



one obtains 



M™*(a N x + b N ) = M N (x) -t M(x; 7 ). 



(V.9) 
(V.10) 
(V.ll) 



(V.12) 



Our basic assumption is that for large but finite N the 
approach to the fixed point goes along some eigendircc- 
tion as 



M N (x) « M(x + e N ip(x; 7, 7'); 7). 



(V.13) 



Here ejv gives the order of the correction and is assumed 
to vanish for large N as characterized by the exponent 
7'- 

Taking the double negative logarithm of both sides and 
using pi.!7[) we get 



l{a N x + b N ) - g(b N ) ps f(x; 7) 



+ ZNf'{x;~()il){x;i,~f). 



(V.14) 



In the next step we shall use the properties (jll.lip and 
pil.3[) together with the equalities f"(0;j) = —7 and 
(|VTT|) . Then double differentiation of (fVT4|) at x = 
yields the perturbation parameter 



ejv = 7tv - 7, 



where 



In 



g"{b N ) _ da N 
g' 2 {b N ) ~ db N ' 



(V.15) 



(V.16) 



The second equality follows from (jV.lljl and is useful in 
practical calculations. 

To summarize the practical recipe, given a parent dis- 
tribution, one calculates "/n and if 



7/v ->• 7 



(V.17) 



then the parent belongs to the domain of attraction of the 
fixed point with parameter 7. Then one determines cn 
from (|V.15p at least to leading order, whose approach to 
zero is characterized by the exponent 7', see (|V.2j) . This 
exponent also determines the eigenfunction ip(x; 7, 7') in 
the final approach to the fixed point, as it appears in 
()V.13|) . In the end, by linear expansion of (|V.13|) . we ob- 
tain the leading correction to the fixed point distribution 
in the form 



M N {x) pa M(a;;7) + e J vM 1 (a;;7,7') 

= M(x; 7) + e N P{x; j)ip(x; 7, 7'), 

corresponding to the density 



(V.18) 



Pn(x) = -^Mn(x) 



P(x;7) + e Wj Pi(x;7,7'). (V.19) 



We relegate to a later work a more detailed discussion of 
the connection to the parent distributions. Some exam- 
ples of specific parents will be considered below. 

The picture that emerges from the RG study comple- 
ments the long-known connection between the Fisher- 
Tippett max-stability condition and the limit distribu- 
tions. By reformulating the former as the fixed point 
relation of an appropriately defined RG transformation, 
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we can then solve the eigenvalue problem for distribu- 
tions close to a fixed point. These eigenfunctions will 
then appear as correction functions in the final approach 
to the limit distribution for large batch sizes N. One new 
parameter labeling the eigenfunctions also emerged, the 
characteristic exponent of the convergence in N. 

The case of marginality, 7' = 0, deserves a special men- 
tion. As it was discussed in Sec. IIII C[ nearby points on 
the fixed line are connected by marginal eigenfunctions. 
Using (|III.20p and substituting there e by = 7^ — 7 
(|V.15|) . we realize that the distribution (|V.18j) is, up to 
leading order, a fixed point distribution with a modified 
index 



M N (x)^M(x; lN ). 



(V.20) 



This property was noted already by Fisher and Tippett 
[l[ in the case of the Gaussian parent, and studied since 
then in the mathematical literature, see [3l[. In the RG 
picture such an asymptote means that the final approach 
to a fixed point is tangential to the fixed line, which hap- 
pens when the finite-size correction decays slower than a 
power law. 



D. Example for a parent in the FTG class: 
generalized exponential asymptote 

We demonstrate the asymptotic analysis above on the 
example of a parent distribution, whose asymptote for 
z — > 00 is of the following generalized exponential form 

fi(z) Pa 1 - Be- Az "/z , S > 0, (V.21) 
g{z) = -ln(-ln/z(») « Az s + 6\nz - InB. (V.22) 

The leading singular parts of the shift and scale param- 
eters are obtained from (jV.10IV.lljl . respectively, as 



b N = g- 1 (In N) 



In TV 



1/5 



yl-5 Oh 1 - 25 

a N = l/.g'(M - " N 



(V.23) 



(V.24) 



AS A 2 S 2 ■ 
Next we calculate from (|V.16|) the effective parameter 

da,M 1 — 5 r 28 — 1 ox 
1N = ^* —b~ N s + 9 b^ s . (V.25) 



db N " AS " N ' A 2 5 2 
The limit gives of course 

IN -> 7 = 0, 



(V.26) 



the parameter for the FTG fixed point. Hence the per- 
turbation parameter to leading order is 



We call the attention to the fact that the above expres- 
sions do not depend on A and -B, they would enter only 
in the next order in 1/lniV. It should also be noted 
that the case S = 1, 9 = is special since it is not suffi- 
ciently specified by (|V.21[) and further corrections to the 
asymptote need to be included. A representative case is 
the pure exponential parent distribution which will be 
treated below in this section. 

In the cases described by (|V.27|) . the decay is slower 
than power law, thus 



7' = 0. 



(V.28) 



We can see that the reciprocal logarithmic finite-size cor- 
rection is valid for all S ^ 1, so it is indeed typical, as 
surmised from nonlinear RG theory. Note that, for 6^1, 
the value of 9 does not enter the leading term in e^r , as 
can be seen from (|V.27[) and anticipated from the fact 
that the power factor z 6 in (|V.21j) represents a next to 
leading correction in the exponent. Exceptionally, when 
5 = 1 the 6 dependence does appear in the leading term 
of eat as shown in (|V.27|) . 

A further result of the nonlinear RG was the EVS dis- 
tribution to second order in e, (jIV.lj) . with tp2{x',s) = 
sx 3 /6 as given by pV.9[) . Here the coefficient s is related 
to the magnitude of the perturbation parameter ejv by 
Eq. CO}. From the comparison of Eqs. (|V.4|V.27|) we 
get 



5- 2 

6- 1' 



(V.29) 



The parameter s defines the second order finite-size cor- 
rection for the extreme value distribution. Note that, for 
consistency, an expansion up order 1 / ln 2 N should also 
involve the expansion of to this order. 

The case S = 1 with 9 ^ corresponds to a power- 
corrected exponential asymptote of the parent, when the 
perturbation parameter e^r exhibits reciprocal square log- 
arithmic convergence. This is the situation treated in the 
end of Sec. IIVI Comparison of (|V.6[) and the second line 
of ftV57\t gives 



2sgn(#) 



(V.30) 
(V.31) 



The family of asymptotes for the parent distribution 
(IV.2ip comprises some notable cases. First we mention 
the Gaussian parent having S = 2, 8 = 1, thus by (|V.27|) 
we get €n ~ —1/2 In AT and so the linear correction de- 
fined in (|V.18j) becomes 



£n = In 



, S?l, 



1-5 
S\nN 

9—^— , 8 = 1. 
In N 



(V.27) 



cnMi(x) 



.2" 



4 In N 



(V.32) 



The same result is obtained for the Rayleigh parent dis- 
tribution, fi(z) = 1 — e~ x , where S — 2, 9 = 0. Another 
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situation, which was used in |2j], is 5 = 1, 6 = 1, describ- 
ing the exponential distribution with a l/z factor. This 
is in fact the asymptote of the distribution of the sizes of 
connected components in subcritical site percolation. In 
this case (|V.27|) yields £n ~ l/ln 2 iV and the correction 
to the distribution becomes 



Mi (x) 



2\nN 



(V.33) 



Finally we mention the pure exponential decay, corre- 
sponding to 5 = 1 and 9 = 0. In the above approxima- 
tion cm — 0, thus one has to go to a higher order in g(z). 
As a notable example we consider the exponential par- 
ent /i(z) = 1 — e~ Az , where g(z) sw Az — ^e~ Az , and so 
b N w A- 1 InN and a N « A' 1 - (2A)- 1 e~ Az . Then the 
effective 7_/v = daw/dhiy ~ (27V) -1 , which equals now 
ejy. Thus the decay index is 7' = — 1 and 



eArMi(x) 



f 



2JV 



(V.34) 



gives the leading correction to the asymptotic FTG fixed 
point distribution. Note that the above correction func- 
tions are understood with the standardization (|II.8|) . so 
in empirical data analysis a further linear change of vari- 
able may have to be considered. 

0.02 



0.01 



PlT 



-0.01 



-0.02 





gauss (8 = 2, 6 = 1) - 




exp (8 = 1,9 = 0) 




exp/pow (8=1,6=1) 




N = 100 







FIG. 1: (Color online) First order corrections ejvPi (x, 7, 7') = 
[ejvMi(x, 7, 7')]' to the limit distribution density in the FTG 
class, 7 = 0, for the generalized exponential case fi(z) ~ 
1 - Be~ Az /z°. The different magnitudes of the shape cor- 
rections are illustrated by evaluating the amplitude eat at the 
same batch-size N = 100. Note that while the curves marked 
as gauss and exp have the same shape with different prefac- 
tors, the functional form of exp/pow is slightly different. 

FiglD displays the corrections to limit distributions 
for the three examples treated above (|V.32IV.33IV.34|) 
using the standardization (|II.8j) adopted here for theo- 
retical reasons. The aim here is to illustrate empirical 
plots of the first order corrections including the ampli- 
tude e^r. One can clearly see that the fastest conver- 
gence occurs for the exponential parent distribution. Fur- 
thermore, while the functional forms for the Gaussian 



(S = 2, 9 = 1) and for the power law corrected expo- 
nential (5 = 1,9 = 1) are the same, the difference in 
the sign of the correction makes the empirical distinction 
apparent. 



VI. UNSTABLE EIGENFUNCTIONS AND 
INVARIANT MANIFOLDS 

So far we have been concentrating on the small neigh- 
borhood of the fixed line. However, regions far away from 
the critical line where the space of distribution functions 
with respect to the RG transformation becomes more 
complex, are also of interest. In order to explore those re- 
gions, we should select special parent distributions. Upon 
the action of the RG transformation with p > 1, the par- 
ent distributions we considered approached a fixed point 
along a stable eigendirection. This is the last surviv- 
ing perturbation and represents the finite-size correction 
to the limit distribution for large batch size N, and is 
characterized by 7' < 0. On the other hand, eigenvalues 
A = p 1 > 1 also exist corresponding to 7' > 0. So the 
question naturally arises: what happens, if we start out 
from a parent distribution that is close to a fixed point 
labeled by 7, and differs from it in an unstable eigen- 
function ip(x; 7, 7') with a small magnitude e. Initially, 
the distribution will move away from the fixed point by 
the action of the linearized RG but the evolution be- 
comes nontrivial at later stages due to the nonlinearitics 
present. One can nevertheless pose the question whether 
parent distribution belongs to the domain of attraction 
of a standard EVS fixed point. 

By evolving a distribution containing an unstable 
eigendirection as a perturbation about a fixed point, an 
invariant unstable manifold emerges. This manifold can 
be determined order by order in the perturbation param- 
eter e, by the successive application of the RG transfor- 
mation. An ambiguity emerges, however, as to how a per- 
turbation proportional to e is introduced. This is exem- 
plified by two natural choices of distributions (|III.1|III.2[) , 
redisplayed with an cigenfunction as perturbation 

H\(z) = M(z + eip(z;j,Y);j), (Vl.la) 
IMt(z) = M (z; 7) + eP{z- 7)^(2; 7, V), (VLlb) 

where M is a fixed point distribution, P its density, ip is 
given by (|III.15|) . and e is a small, but fixed, parameter. 
While these distributions are the same up to linear or- 
der in e, they generically differ in higher order terms and 
in their large-z asymptote. Thus it matters which dis- 
tribution we start with, because they will track different 
manifolds. More variants equivalent to linear order are 
also possible, but we restrict our attention to the above 
two types. 

A problem to be considered when various linear per- 
turbations arc introduced, as in Eqs. jSH , is that we 
should have a valid (monotonic from to 1) distribution 
for finite e in some support in z. Since the eigenfunctions 
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tp(z; 7, 7') are non-monotonic in z, extra care should be 
exercised. In particular, the equivalence of the two forms 
in (jVI.ip holds only for |e0(z;7,7')| <C \z\, but this con- 
dition is generically not fulfilled in the entire support. 
We circumvent the above problem by considering partic- 
ular parent distributions, specifying which form in (jVI.ll) 
should be understood, and determining some allowed sets 
of the parameters £,7'. Below, we shall discuss sepa- 
rately the unstable invariant manifolds emanating from 
the three classes of fixed point distributions. 



A. Instability near the FTG fixed point 



First we shall consider the parent of the form (jVI.lal) 

rtz)=» 1 (z)=e--'"* W , (VI.2) 
where e is assumed small but finite and fixed, and 

1>(z) = tP(z; 0, 7') = i (l + </* - e 7 ' z ) (VI.3) 

is an unstable eigenfunction with 7' > 0. It is easy to 
see that for < — e < 7' we have a strictly increasing 
li(z) for all z, so the support extends over the entire real 
axis. For sufficiently large z, however, in the region of 
importance for extreme statistics, one has eip(z) 3> z, so 
an expansion in e is no longer legitimate and (|VI.2j) is not 
equivalent to the corresponding formula in (|VI.lb|) even 
for small e. 

We now would like to determine whether the parent 
is attracted to a fixed point, and, if so, what its finite- 
size correction is. The associated parameters will be de- 
noted by 7, labeling the attracting fixed point, and 7', 
specifying the eigenfunction of the final approach. These 
parameters can be determined by means of the relations 
given in Sec. IV CI namely 



j(z) = -]n(-ln/i(z)) 



= z + ei'(z) w -^e 7 2 , 
b N = g^QnN) w I In In A 



a N 



y 2 > h 



g'(b 



(VI.4a) 
(VI.4b) 
(VI.4c) 



Convergence is characterized by the effective 7jv defined 
in (|V.16[) . which now approaches 7, and by the pertur- 
bation parameter given in (|V.15j) . We now have 



da 



In 



n 



db 



N 



7 + £tv 



l' 2 >, 



(VI.5) 



Hence we can easily determine the indices of universality 
7w -> 1 = 0, (VI.6a) 
ejv = In ~ -7— TF' (VI. 6b) 



In AT 



7 = 0. 



(VI.6c) 



The third line follows from the slower than power decay 
in the second one. Note that the function g{z) discussed 
in this subsection diverges faster than any power and, 
accordingly, the result (|VI.6b[) can be obtained as the 
5 -> 00 limit of (jW27]) . 

Summarizing, if we start out from the parent (|VL2|) 
close to the FTG fixed point, but differing from it in 
an unstable eigenfunction then the RG transformation 
drives it to the same fixed point along the eigendirection 
with marginal eigenvalue 1. That is, this unstable mani- 
fold with a 7' > loops back along the marginally stable 
one with 7' = 0. We illustrate this effect as follows. On 
Fig. [2Ji the initial 7' = 1.5 and e = —0.01 was taken, 
and the extreme value density of A variables displayed 
for some increasing A, showing the increasing deviation 
from FTG. The A here corresponds to the parameter p 
of the RG transformation (|II.7[) . Figure O), on the other 
hand, shows that for further increasing A the sequence 
of distributions approach FTG, thus completing the loop 
of the invariant manifold. 

The loop in function space can be further visualized by 
plotting the evolution of difference from the FTG limit 
distribution as A changes (Fig [3]). A feature which can 
be easily seen on this plot is that the initial and the final 
small deviations from the FTG have different functional 
forms corresponding to the different values of 7' and 7'. 

In order to demonstrate the difference of the forms 
(j VI. lap and (TVI.lbj) , next we consider the same pertur- 
bation as in (|VI.2jl but now defined through the form 
(|VI.lbjl . That is, we take the parent 



[l + eip(z)e 



(VI.7) 



where ([VI. 3j) is implied. To have fi(z) — > 1 from be- 
low for z — > 00, we should set 1 > 7' > and e > 0. 
Note that formula (|VI.7|) would yield negative fj,(z) for 
large negative arguments, but /x(z) becomes positive for 
smaller negative arguments, and a sufficiently small e en- 
sures that thenceforth fi(z) is strictly increasing. Thus 
if we discard the region of negativity from the support 
then the function so obtained becomes a legitimate inte- 
grated probability distribution. For small enough e it is 
obviously an unstable direction, and thus the source of 
an invariant manifold after RG transformations. Its large 
z behavior can be characterized by the function g(z) in 
(E3 as 



g(z) = -]n(-kifj,(z)) 



V 
e 

-(i-Y)z 



(1 -y)z + ln-L- + 7 'z e - 7 ' z 
e 

e 



(vi.8) 



where we kept competing exponential terms. Hence, ac- 
cording to the procedure set forth in Sec. IV C( we obtain 

In (e A/7' 2 ) 
b N = g- 1 In A » \ 1 \ > , VI.9 

1 -i 
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FIG. 2: (Color online) Probability densities on the invari- 
ant manifold starting from the unstable parent (|VI.2|) with 
(|VI.3I) : (a) A sequence of densities diverging from FTG. (b) 
A sequence of densities returning towards FTG. The arrows 
mark the direction of TV increasing. The initial e, 7' and fi- 
nal 7' parameters are indicated. Since the effective 7iv tends 
to zero logarithmically slowly, see (|VI,6b[) . one has to go up 
to relatively high TV to demonstrate convergence to the FTG 
distribution. 



-2 2 4 6 

x 

FIG. 3: (Color online) The differences from FTG of the densi- 
ties plotted in Fig. [5] The magnitudes of the solid red curves 
increase while those of the dotted blue ones decrease with TV. 
It is apparent that the initial and final shape corrections have 
different functional form (the solid blue and dotted red curves 
with smallest magnitude). For illustration, the marginal cor- 
rection function ( "theory" ) with the amplitude ejv = — 1/ In TV 
(TV = 5 x 10 8 ) from (|VI.6b|l is also displayed (dashed black 
line), well approximating the last dotted blue curve. 



Hence a nonmarginal asymptotic index, 7' < 0, is ob- 
tained, which characterizes the last surviving cigenfunc- 
tion. This should be contrasted with the previously dis- 
cussed case of (|VI.2[) , where independently of the initial 
7' we had 7' = as shown in (|VI.6c[) . That demonstrates 
the inequivalence of the distributions with unstable per- 
turbations, (| VI. lap and (|VI.lb|) in the sense that depend- 
ing on whether we apply the perturbation additively or in 
the argument, different limiting properties emerge. The 
unstable manifold generated from (|VI.7j) is illustrated on 
Figs. H 



and 



IN 



9"(b N ) 

g' 2 (b N ) 

cTV'^vlnTV, 0<7'<l/2, 
1 

2N' 



(VI.10) 



1/2 < 7' < 1, 



where the constant c depends on e and 7'. Since 

7 = 0, again the FTG fixed point is approached. Thus 

we have &n = 7jVj whose decay is characterized by the 

index 



1 



1-7'' 



< 7' < 1/2, 
1/2 < 7' < 1. 



(VI.11) 



B. Instability near the FTF fixed point 



Consider the parent of the type (|VI.lal) 



(VL12) 



where ip(z) abbreviates ip{ z ) 7? 7') as given by (|III.15|) 
and 7,7' > 0. This is a legitimate integrated distribu- 
tion in [—1/7,00) if 7' > — e > 0. Note that [i(z) has 
a positive value at the lower border — 1/7, below it we 
define fi(z) to be zero. 

We again denote by 7, 7 the characteristic parameters 
for the above parent. The procedure for calculating them 
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(VI.17) 



This is just the asymptotic exponent in 6/v oc N 1 , which 
also can be obtained from (|VI.14[) and the dominant term 
in piI.15[) . Next, we have to determine the leading power 
of N in 



6jv = 7at — 7 oc N 1 



(VI.18) 



One should distinguish the case 7' = 7, the amplitude 
of the term y N J ^ vanishes in (|VI.16|) . and the leading 
correction becomes y~^ 2 '. Using 6/v oc i/n in (|VI.16[) we 
finally obtain 



7 = 



77 
7' +7 



-7 , 



, 7' + 7, 



7=7. 



(VI.19) 



We illustrate the above described invariant manifold on 
Fig. [SI with starting parameters 7 = 1.5,7' = 3 resulting 
in final ones 7 = 0.5,7' = — 1- 



FIG. 4: (Color online) Probability densities on the invari- 
ant manifold starting from the unstable parent (|VI.7|) with 
(|VI.3[) : (a) A sequence of densities diverging from FTG. (b) 
A sequence of densities returning towards FTG. Arrows mark 
the direction of increasing /V. The convergence to FTG is 
markedly faster than that along the marginal eigendirection 
in Fig. E| 



was described in Sec. IV CI We now have 



g(z) = -ln(-ln/i(z)) 



a N 



— ln(l + -fz + -feip(z)), 
7 

l + -yb N + jei/>(b N ) = IF>, 
1 1 + "fb N + jeip(b N ) 



N) 



l + eiP'(b N ) 



(VI.13) 
(VI.14) 
(VI.15) 



Expanding the above formula in = 1 + 7&at, using 
(TVT6]) and the expression for ip(z) in (|III.15|) . we obtain 



da 



N 



da 



7" 



N 



db N dy N 



1' 



7-7 , 1 ,\ -777 

7+7 7 + 7 \N 



0{ y jf'i- 1 ) + 0(yjr n )- (VL16) 
The l&rge-N limit determines the index of the attracting 
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FIG. 5: (Color online) Sequence of densities on an invariant 
manifold of the form (]VI.12[) . with increasing /V tracking the 
RG trajectory. In variance with the FTG case, the starting 
and final distributions are different here. Note that while 
convergence to the latter is well demonstrated, the maximum 
decreases to below the limit before the final approach. This is 
related to the fact that the effective 7jv in (|VI.16[) approaches 
the limit from below. 



In order to demonstrate the inequivalence of (| VI. lap 
and (|VI.lb|) also in the FTF case, we consider the exam- 
ple 



-(1+7*) 



l + eV->(.z)(l + 7^r 1/7 " 1 



(VI.20) 

Given the form of ip in (1111.150 . the decay of the per- 
turbation for large z requires 7' < 1. It is easy to see 
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that near the lower border of the support of the unper- 
turbed limit distribution, in some interval for z < 0, this 
function is negative. Then for increasing argument it be- 
comes positive, and for not too large e it remains mono- 
tonic thereafter. Since the EVS limit behavior depends 
on the large- z asymptote, we simply discard the region of 
negativity from the support, thus we wind up with a le- 
gitimate parent distribution, given by (|VI.20[) whenever 
it is non-negative. We keep only the asymptotic terms 
necessary to determine the final indices 

g(z) = -ln(-ln/i(z)) 



ln(l + jz) + c\ 

7 

+ c 2 (l + 7 ^)" 7 ' /7 + c 3 (l + 7*r (1 ~ T ' )/T , 



(VI.21) 



where the constants Cj depend on the parameters e, 7, 7'. 
Repeating the steps of the procedure set forth in Sec. 
FVCl we find 



1-7' 



7 



< 7' < 1/2, 



I-7'' 
-1, 1/2<7'<1. 



(VI.22a) 
(VI.22b) 



On Fig. [5] we illustrate this case with e = 0.01,7 = 
0.5,7' = 2/3. The asymptotic indices can be read off 
from Eq, (|VI.22|) as 7 = 1.5 and 7' = -1. 
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FIG. 6: (Color online) Sequence of densities on an invari- 
ant manifold starting out from (IVI.20|I . where increasing N 
follows the RG trajectory. Again, the starting and final dis- 
tributions are different, but in contrast with the case (|VI.12J> . 
illustrated on Fig. [5] the final 7 is larger than the initial 7. 

Summarizing, the parent with perturbed argument 
(|VI.12|) . representing an unstable function near an FTF 
fixed point with 7 > and having an instability param- 
eter 7' > 0, will eventually be attracted to another FTF 
limit distribution with 7 as in (|VI. L7|) . The final ap- 
proach happens along the stable manifold with parame- 
ter 7' as in (|VI.19[) . In contrast, if we additively perturb 



the fixed point and take for the parent (|VI.20[) . we get a 
different set of indices 7,7', as given in (|VI.22I) . 



C. Instability near the FTW fixed point 

In the FTW case, the two types of parent distributions, 
(|VI.la|) an d (|VI.lb| ) ha ve the same formulas as for the 
FTF class, (|VI.12j) and (|VI.20|) . respectively, but we have 
7 < for FTW. As we shall see, however, the properties 
of the FTW case cannot be obtained by trivially changing 
the sign of 7 in the FTF results. 

Consider first the parent of the form (|VI.12|) . with 7 < 
0. For our present purposes it suffices to mention that for 
7' > — e > monotonicity holds, furthermore, the upper 
limit of the support z* , where g(z) diverges, is some value 
below 1/|7|. Near z* the argument of the log in (|VI.13[) . 



p730) 



(VI.23) 



is analytic, whence we can determine the indices of uni- 
versality following Sec. IV CI We have to determine the 
effective index 



In = 7 + ew 



9"(b 



9' 2 (b N ) 



7" 



^{b N )^"{b N ) 



N) 



(VI.24) 



Now the N — > 00 limit of the effective 7jv gives 7, while 
the decay of provides the index 7'. They can be ob- 
tained by noting that from (|VI.14[) we have </>(6/v) = N 7 
and higher derivatives of 4>(b]\r) go to constants. Thus 
the limit of (|VI.24|) is 

7 = 7, (VL25) 
and the exponent of convergence of e^r is equally 

7. (VI.26) 



7' 



Thus, we found that the unstable manifold returns to 
the same fixed point along the stable manifold whose 
stability parameter 7' coincides with the fixed point pa- 
rameter, irrespective of the initial value of the instability 
parameter 7'. 

Turning to the case of the additively perturbed distri- 
bution, we use (|VI.20|) with 7 < 0. If 1 > -7 > 7' > 
then, for not too large e > 0, one has the same upper 
limit of support z* = -I/7 as in the unperturbed case, 
and 



— ln(— lnyu(z)) 
1+7 



7 



ln(l + 72;) + d-y 



(VI.27) 



+ da(l + 7^) 7 ' /7+1 + d 3 (l + 7^)~ (1+7)/7 , 



where dj are constants. We calculate again the effective 
7tv according to Sec. IV CI and wind up with the following 
final indices 



7 : 



1 



1 + 7' 



7 + 7' 
1 + 7 



,-1 



(VI.28a) 
(VI.28b) 
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Comparison of (|VI.28|) with (|VI.25IVI.26|) demonstrates 
once more that the asymptotic properties strongly de- 
pend on the way the unstable perturbation is applied. 
Plots of the evolution of distributions as N increases for 
initial states with 7 < < 7' are qualitatively similar to 
previous figures, therefore we do not display them. 

D. Unstable manifolds in function space 

The results above on the unstable manifolds emanating 
from the eigendirections of the form (jVLlajl are graphi- 
cally represented in function space on Fig. [7l If we start 
out from a parent distribution near the fixed point with 
7, in the direction of the unstable eigenfunction with 
7' > 0, then upon the action of the RG transformation 
the distribution function moves on an unstable manifold. 
For 7 < 0, the FTW case, the unstable manifold loops 
back towards the same fixed point, whose neighborhood 
it started out from. On the other hand, in the FTF 
case, 7 > 0, the RG trajectory will wind up in the fixed 
point with 7 < 7, as given in (|VI.17|) . falling between the 
starting and the FTG fixed points. The characteristic 
parameter of the stability is 7' = 7 for the case 7 < 0, 
whereas for the FTF class, 7 > 0, the parameter of the 
stable cigendirection is given by Eq. (|VI.19|) . 




7 



7'=7 = 7<0 7' = 7 = 7 = 7(< 7) 7>0 
FTW FTG FTF 

FIG. 7: Illustration of the invariant manifolds of various fixed 
points in the space of probability distributions. Starting dis- 
tributions near a fixed point with some 7, differing from it by 
an eigenfunction with a parameter 7' > 0, with the definition 
in (IVI.la|l . The straight line is the 7 axis and the directed 
curves represent RG transformation flows. Each flow ends up 
in a fixed point with 7 along a stable direction characterized 
by the finite-size index 7' < 0. The approach to the FTG 
fixed point is along the marginal direction 7' = 0, which cor- 
responds to a small perturbation on the fixed line, as discussed 
inSec.EIC] 

The invariant manifolds starting from unstable distri- 
butions of the form (|VI.lb|) are illustrated on Fig. [SJ For 
the cases 7 / the RG trajectory will wind up in the 
fixed point with a different 7, farther from the origin. 
This can be understood from the fact that the additive 
perturbation in (|VI.lb[) slows down the asymptote of the 
distribution, while such effect is not present if the per- 
turbation is in the argument like in (| VI. lap . The char- 
acteristic parameter of the asymptotic stability is 7' < 
in all cases. 




7 



7(< 7) 7<0 7 = 7 = 7>0 -y(> 7) 



FTW FTG FTF 

FIG. 8: Illustration of the invariant manifolds from starting 
distributions with 7' > in the definition (|VI.lb|l . Each flow 
converges to a fixed point with 7 along a stable direction 
characterized by a finite-size index 7' < 0. 



Note that on the fixed line there is a symmetry be- 
tween a 7 > and its negation, i.e., the FTF and FTW 
cases. In particular, in the FTF case with a 7 > 0, the 
variable 1 + 72; has the same distribution as in the FTW 
case, with the parameter —7, the variable 1/(1 — 7^) has. 
Nevertheless, this symmetry does not manifest itself for 
the invariant manifolds. On the one hand, in (j VI. lap 
the symmetry is broken, since ip is added to the variable 
itself in the argument. This is also responsible for the 
effect that in the FTF case the decay of the limit distri- 
bution is stronger than that of the parent. On the other 
hand, for the additively perturbed distributions of the 
form (jVI.lbjl there is a qualitative symmetry, in that the 
RG trajectory loops back to the fixed line farther from 
the origin for both signs of the starting 7. The particular 
values of the final 7, 7' indices, as given by (|VI.22[) and 
(jVI.28[) . however, do not exhibit the sign flip symmetry 
of the fixed line. 



VII. CONCLUSION AND OUTLOOK 

We have shown how finite-size corrections to EVS limit 
distributions can be derived by borrowing ideas and ter- 
minology from the RG theory. The corrections in shape 
and amplitude emerged from the action of the RG trans- 
formation on the function space associated with the close 
neighborhood of the fixed line of limit distributions. This 
RG approach provided the classification of the first-order 
corrections and, furthermore, it also helped to establish 
the connection to parent distributions, thus making the 
results practically useful. A remarkable feature of the RG 
theory is that the study of the linear neighborhood of the 
fixed line reveals orbits - invariant manifolds - of the RG 
transformation which first diverge and later return to the 
same or to a different point on the fixed line. 

There are several problems in EVS where the RG ap- 
proach developed here may be of interest. Within the 
theory of EVS of i.i.d. variables, the RG theory should 
be instrumental in developing a compact treatment of 
the finite-size corrections for order statistics in general, 
among them for the 2nd, 3rd, etc. maxima, as well as for 
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their various joint statistics. Furthermore, higher order 
corrections are also of interest from the empirical view- 
point, especially in the case of the logarithmically slow 
convergence. 

The next level of difficulty is met when trying to in- 
vestigate the problem of weakly correlated variables (a 
nontrivial example is the stationary sequence of Gaussian 
variables with correlation decaying as a power law) where 
the EVS limit distribution of the maximum is known 
to be FTG [32j). There the question arises naturally, 
whether the finite-size corrections elucidated in this pa- 
per remain valid for families of sufficiently weakly cor- 
related variables. There is ground to believe that the 
finite-size corrections may be the same [33| but further 
studies are needed to clarify the matter. 

Finally, the extension of the RG approach to calculate 
the EVS of strongly correlated systems appears to be a 
real challenge. We are aware of only one work J2f| where 



the so called real-space renormalization group was devel- 
oped for obtaining EVS of random walk type processes. 
The results are restricted presently to the limit distribu- 
tions for these processes. It would be certainly interesting 
to extend the method to find the finite-size corrections 
and compare with the phenomenological approaches [23| 
since some of them suggests that the shape corrections 
can be calculated from the limit distributions. 



Acknowledgments 

This research has been supported by the Swiss NSF 
and by the Hungarian Academy of Sciences through 
OTKA Grants Nos. K 68109, K 75324 and NK 72037. 
MD acknowledges the hospitality of the Physics Institute 
of the Eotvos University. 



R. A. Fisher and L. H. C. Tippett, Procs. Cambridge Phi- [16 
los. Soc. 24, 180 (1928). 
E. J. Gumbel, Statistics of Extremes (Dover Publica- [17 
tions, 1958). 

W. Weibull, J. Appl. Mech.-Trans. ASME 18, 293 (1951). [18 
P. Embrecht, C. Kliippelberg, and T. Mikosch, Modelling 
Extremal Events for Insurance and Finance (Springer, [19 
Berlin, 1997). 

R. W. Katz, M. B. Parlange, and P. Naveau, Adv. Wa- [20 
ter Resour. 25, 1287 (2002). 

H. v. Storch and F. W. Zwiers, Statistical Analysis in Cli- [21 
mate Research (Cambridge University Press, Cambridge, 
2002). [22 

B. Gutenberg and C. F. Richter, Bull. Seismol. Soc. Am. 
34, 185 (1944). [23 
J.-P. Bouchaud and M. Mezard, J. Phys. A 30, 7997 
(1997). [24 
S. Raychaudhuri, M. Cranston, C. Przybyla, and [25 
Y. Shapir, Phys. Rev. Lett. 87, 136101 (2001). [26 
T. Antal, M. Droz, G. Gyorgyi, and Z. Racz, Phys. Rev. [27 
Lett. 87, 240601 (2001). 
G. Gyorgyi, P. C. W. Holdsworth, B. Portelli, and [28 
Z. Racz, Phys. Rev. E 68, 056116 (2003). 

P. Le Doussal and C. Monthus, Physica A 317, 140 [29 

(2003) . 

S. N. Majumdar and A. Comtet, Phys. Rev. Lett. 92, [30 
225501 (2004). [31 
S. N. Majumdar and A. Comtet, J. Stat. Phys. 119, 777 [32 
(2005). ' [33 

C. J. Bolech and A. Rosso, Phys. Rev. Lett. 93, 125701 

(2004) . 



H. Guclu and G. Korniss, Phys. Rev. E 69, 065104(R) 
(2004). 

P. L. Krapivsky and S. N. Majumdar, Phys. Rev. Lett. 
85, 5492 (2000). 

A. Comtet, P. Leboeuf, and S. N. Majumdar, Phys. Rev. 
Lett. 98, 070404 (2007). 

J. F. Eichner, J. W. Kantelhardt, A. Bunde, and 

S. Havlin, Phys. Rev. E 73, 016130 (2006). 

L. de Haan and S. Resnick, Annals of Probability 24, 97 

(1996). 

L. de Haan and U. Stadtmiiller, J. Australian Math. Soc. 
61, 381 (1996). 

G. Schehr and S. N. Majumdar, Phys. Rev. E 73, 056103 
(2006). 

G. Gyorgyi, N. R. Moloney, K. Ozogany, and Z. Racz, 

Phys. Rev. Lett. 100, 210601 (2008). 

G. Jona-Lasinio, Phys. Rep. 352, 439 (2001). 

G. Schehr and P. Le Doussal, arXiv:0910.4913 (2009). 
S.-K. Ma, Rev. Mod. Phys. 45, 589 (1973). 

H. J. Hilhorst, M. Schick, and J. M. J. van Leeuwen, 
Phys. Rev. Lett. 40, 1605 (1978). 

S. R. McKay, A. N. Berker, and S. Kirkpatrick, Phys. 
Rev. Lett. 48, 767 (1982). 

H. G. Schuster and W. Just, Deterministic Chaos: An 

Introduction (Wiley-VCH, 2005). 

M. I. Gomes and L. de Haan, Extremes 2, 71 (1999). 

E. Kaufmann, Extremes 3, 39 (2000). 

S. M. Berman, Ann. Math. Statist. 33, 502 (1964). 

G. Gyorgyi, N. R. Moloney, K. Ozogany, and Z. Racz, 

Phys. Rev. E 75, 021123 (2007). 



